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Executive Summary 



This report describes the results of a field test of "Federalism/ a program from The U.S. 
Constitution, an instructional video series for students In Junior and senior high 
school. Currently under development by the Agency for Instructional Technology and a 
consortium of state and provincial education agencies In association with Project *87, 
The U.S. Constitution will be available In September 1987. 

Students and teachers reacted positively to "Federalism." Teachers indicated that the 
content was appropriate for their students and thought It would appeal to them. They 
said they were excited at the prospect of having such high quality materials on the Con- 
stitution available this fall. Several teachers commented that they were especially im- 
pressed with the documentary section and with Bill Meyers as the narrator. 

The students said their favorite part of the program was the dramatic segment; their 
least favorite parts were the animation and narration segments. Some called BUI 
Moyers "boring." Students liked tne way the program presented a constitutional issue 
In a story to which they could relate. Most enjoyed the drama, although a few students 
commented that they thought the example was "too dramatic." 

In general* the classes that viewed this program wei'e veiy favorably impresjed with It. 
Students said that programming such as "Federalism" would definitely make learning 
about the Constitution more meaningful and Interesting. Teachers commented that 
there is a great need for such high quality materials on the Constitution. Without ex- 
ception, the teachers who viewed "Federalism" were enthusiastic about It. 
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The U:& Constitutton project was begun In 1980. ATT. in association with Project '87 (a 
joint activity of the American Historical Association and the American PollUcal Sci- 
ence AssoclaUon). initiated needs assessment activities, textbook reviews, and evalua- 
tion of existing audiovisual materials. The culmination of this prellmlnaiy work was 
a prospectus Utied A Video Prqfect to Increase Understanding of the United States Con- 
stitution for Junior and Senior High School {September 1985). The overaU goals of the 
project. ^ set forth In the prospectus, are *to increase apprcclaUon and understanding 
of the U.S. ConsUtuUon. to show recurring consUtuUonal Issues In historical context, 
and to moUvate criUcal thinking about such recurring issues." 

The final version of the instrucUonal design was completed In ;^rll 1986. The design 
document consists of content specifications for six programs. Scripting of the pro- 
grams began in the sunuiier of 1986. Scripts for all programs werr xeviro^ed by consor- 
tium representatives and classroom teachers. The first script sent to the consorUum 
for review was -Federalism: Balance of Power Between National and State Govern- 
ments" (October 1986). 

A preliminary version of "Federalism" was taken to classrooms for evaluaUon during 
the first week of May 1987. Evaluators coUected data from students and teachers 11) by 
observing them while they viewed the video. (2) from post-viewing quesUonnalres. and 
l3)Jrom post-viewing classroom discussion. The remainder of this report is a summaiy 



Sample 



A total of 183 students viewed the video. Table 1 describes the sample by sex: table 2 
gtves the frequency distribution oy grade Icvei. 



Table 1 



Male 44% 
Female 54% 
No response 2% 



Tddc2 



Grade? 16% 

Grade 9 19% 

Grade 10 28% 

Grade 11 12% 

Grade 12 16% 

No response 9% 



The students were from four schools tn Illinois and Indiana. (Appendix A) 

Monticello High School is located in a small agricultural community in north-central 
Illinois. The 545 students enrolled there come from predominantly middle-income 
agricultural backgrounds. There also is a communication cable industiy in town. 

Uibana Junior High is located in Champaign/Urbana, Illinois, where the University of 
Illinois Is the primary employer. A broad ml;: of ethnic groups and socioeconomic lev- 
els is present in the student body. The largest minority group is black, comprising 10 
percent of the students. A number of foreign students are chUdren of student or in- 
structors at the university. 

Columbia Middle School Is a "magnet school* for the same area: students from the en- 
tire city can choose to attend this school. The socioeconomic makeup of the student 
body Is similar to that of the students at Urbana Junior High. 

The fourth school included in the evaluation was Columbus North High School, in 
Columbus. Indiana. Several major corporations, including Arvln Industries and 
Cummins Engine, have plants in Columbus. The three classes visited Included students 
from all socioeconomic and ability levels: most of the students were tn the "middle* so- 
cioeconomic level and of "average* ability. 



Methodology 



Fach classroom visit consisted of several parts: introduction and pre-vlewlng discus- 
sion, actual viewing, post-viewing questionnaire, and post-viewing discussion. 

The opening discussion explained the purpose of the visit and encouraged students to be 
honest in their comments about the video. Evaluators attempted to make the students 
feel at ease ana to create a comfortable atmosphere for discussion by asking such ques- 
tions as: "What TV shows do you enjoy watching?" "What does a television critic do?" 
and "What do you think our fthe evaluatorsi Job is?" 

During the viewing of the video, students' reactions were carefully recorded. Evaluatore 
attempted to make themselves unobtrusive while taking note of how students re- 
sponded to the program. (Did they appear interested in the program? Were they bored? 
Did they laugh at particular parts?) 

Next, both students and teachers were asked to complete questionnaires. Questtons 1-8 
of the student quesUonnalre (^pendix B) concentrated on general appeal; questions 9- 
U. on content. The teacher questionnaire {Appendix C) asked quesUons on general ap- 
peal, instructional effectiveness, and the pro^xmi's expected outcomes. 

In the post-viewing discussion (Appendix D). students were asked both appeal and con- 
tent questions: "How dkl you like the program?" "What did you like the most about the 
program?" "What did you like the least about the program?" and "What did you think 
the main klea of the program was?" Students were encouraged to elaborate on their re- 
sponses: also, appropriate follow-up questions were asked: "Why didn't you like the 
documentary segments?" "What would you suggest to make the accident scene more re- 
alisUc?" Finally, students were asked. "If you could talk to the producer, what sugges- 
tions would you make?" 



student Questionnaire Data 



See Appendix B for a summaiy of students' responses to the questionnaire. Questions 1- 
3 assessed the appeal of the program to students. Tabie 3 summarizes t' .ese results. 



TatdsS: OvervlewofRetpoiitet to Questions 1-3 

•Strongly Agree" "Agree" 

Question 1 (-Interesting?-) 15% 76% 

Question 2 (-Appealing?") 14% 60% 

Question 3 (Tlked it?") 19% 61% 



As Table 3 demonstrates, the program was appealing to almost all the students. What 
segments were most appealing to them? Twenty-four percent of the students responding 
to question 7 said they liked all parts of the program. Responses to questions 7 and 8 
Indicate that students liked the dramatization best and the documentaiy and anima- 
tion segments least. Evaluators' obsenrations reinforce this findlr^. 

As for content, over half (60%) answered that the Supreme Court settles disagreements 
between the federal government and a state government. Nearly everyone (83%) re- 
sponded that the Civil War strengthened the federal government's power. 

Different segments of the program seem to transmit mixed messages about who has the 
most power. The documentary segments on the Depression and Civil Rights emphasize 
the power of the federal government, whUe the dramatic situation emphasizes the 
power of the states. Student responses reflect this mixed message: 39% said the fed- 
eral government has the mo:>t power, 30% answered that power is shared by federal and 
state governments, and 21% said the state goverrmient has the most power. 

Chi square comparisons of sex and grade by all items were made. Wo significant differ- 
ences were found on any item according to grade or sex. 
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Teacher Questionnaire Data 



All nine teachers who viewed the Federalism program were impressed with it (see Ap- 
pendix C for frequencies). The teachers' comments were similar to students' responses 
to the question, "What did you like the most about the program?" (See the "Classroom 
Discussion" section of this report.) For example, one teacher wrote, "I think the pro- 
gram really captured the attention of the students by giving personal, realistic, and rel- 
evant situations." Another teacher responded. The using of young people in situations 
that Involve their lives dramatically... was the strong point of the presentation. Tnis 
involvement really was evident In the classes' eyes." 

Six teachers answered "yes, definitely" to the question "Do you think the program is 
appropriate for students in grades 7-12?" The other three responded "yes, probably," 
and explained that they thought the material may be too advanced for seventh and 
eighth graders. 

In response to the question, "Do you think the animation segment (balance beam) was 
effective?" four checked yts, veiy effective," four responded ^es sort of effective," and 
one answered "no, not veiy effective." One teacher wrote, "The animation was maybe 
the weakest part of the film- students maybe did not catch on to exactly what it was 
representing." 

There were no further comments on the teacher response forms. All teachers indicated 
that they would recommend this program to other teachers: six would highly recom- 
mend it. 
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Evaluators' Observations 



Students were attentive through most of the opening minutes of BUI Moyers* first docu- 
mentary sequence. Their attention lagged as the segment progressed. When the first 
dramatic segment began, students were once again very attentive. 

In the first dramatic segment, some students snickered or commented among them- 
selves when David kissed M^Arta. Also in this part, several students in one class laughed 
when the accident happenetl. 

Students* attention wandered somewhat in tb^ second documentary segment, but 
picked up again in the dramatization. In all classes, students were very attentive lo the 
dramatic segments, but their attention lagged during the documentary and animation 
segments. 



" n 



Classroom Discussion 



Som^ students founc BUI Moyers' monologue to be boring, but others liked it. Several 
students in one class thought that Moyers' appearance and manner was too formal. 
Others thought that the presentation in these segments was very appropriate for the 
subject matter. 

A few students laughed at the accident scene. When asked about this, they gave two rca- 
sons: the accident looked "fake," and it came as a total surprise and seemed overly 
dramatic. 

When asked "How did you like the program?" most responses were short and noncom- 
mittal. ("It's OK." "It's all right.") But the subsequent discussion in all classes would 
suggest that these initial responses were affected by the fact that it took students a few 
minutes to feel at ease in the discussion. 

The thing students liked most about the program was the dxama. They liked the story 
and the fact that it taught them about an important issue concerning the Constitution 
by means of an interesting dramatization to which they could relate. Most thought the 
drama presented a clear and realistic example of the division of federal and state power 
and how this division can affect a person's life. Several students commented that they 
learned more about federalism from watching this program than if they had Just read 
about it in a book. 

Students in all classes said they did not like the animation part of the program. They 
gave various reasons. Some said the segments were too short, and hard to understand. 
A few said that the balance beam did not seem to be related to the rest of the program. 
Several high school stud-nts considered the animation part "childish" and inappro- 
priate for a program on the Constitution. 

Some students said David's reacUon to the accident was totally unrcalisUc. They said 
that if they were David, they would have been a lot more depressed about not being able 
to walk and swim and not so concerned about whec.ier or not they could go back to 
school. One student commented, "David should have sued the guy in the van Instead of 
going back to school." 



Conclusions 



?tuG' liked the dramatic portion of the program very much— they seemed to relate 
well tu the characters ai^d found the story believable. While a few students thought the 
wheelchair example was overly dramatic, most thought it was good because it illus- 
trated tough Issues to which there are no simple answers. Students became involved in 
the stoiy and wanted to know how it ended. 

They were least attentive to the inlmation and documentary parts of the video. Some 
high school students thought t!ie animation was childish and inappropriate in a pro- 
gram on the Constitution. Sti:dents in both iunior high and senior high found the ani- 
mation segments hard to understand and thought they somehow needed to be made 
"more clear.** Wtien asked about the documentary part^ of the program, the general 
complaint was that "Bill Moyers is boring.** It's curious that the program begins with 
•^n animated segment followed by a documentary segment, the students' two least 
favorites. 

One of the key findings was that, after viewing the video, students were divided or no 
has the most power, the federal or state government. More students thought "the federal 
government has the most power" than that "power is shared between the federal and 
state governments* or that "state government has the most power.** This division prob- 
ably is not surprising, because dl£rerent segments of the program emphasize different 
interpretations of federal and state power. 

Teachers reacted quite positively to the program. Unlike their students, they were im- 
pressed with the documentaiy segments. They found Bill Moyers' presentation effective 
and liked the way the documentary and drama complimented each other. One teacher 
did not think the animated segments were effective. 

Overall, teachers and students reacted positively to the Federalism program. Even 
though students were not enthusiastic about the documentary and animation segments, 
most responded that they liked the program and found it intereoting. It seems that the 
dramatic segments ar* so compelling that they more than compensate for students' 
negative i-eactlons to the animation and documentary segments. 
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Appendix A 

Participating Schools 



IlUnois 

Montlcello High School. Monticello 
Urbana Junior High School. Urbana 
Columbia Middle School. Champaign 



Indiana 

Columbus North High School. Columbus 
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Appendix B 



a 5. Constitution 

Student Questionnaire 



Grade Level (Circle) 7 8 9 10 11 12 
Male '*5% Female 5U% 

School ^ Date 



1. The program was interesting 

2. The program was appealing 

3. I liked the program 

4. The story was believable 

5. The teenagers in the story 
acted naturally 

6. I learned something new 
from this program 



strongly 
agree 
15% 


agree 
76% 


not 
sure 
5% 


disagree 
2% 


Strongly 
disagree 
1% 


1U% 


80% 


?o| 


51 


0^ 


19% 


61% 






l\ 


37% 




13% 




2\ . 


21% 


U7% 


19% 


9% 


3% 


17% 


48% 


22% 


8% 


3% 



7. Which part of the program did you like the mott? 
9% the documentary (Bill Moycrs) 
59% the dramatization (high school swimmers) 
8% the anlmauon (the balance beam) 
2U% lUkcd all parts 

Why: 



8. Which part of the program did you like the least? 

47% the documentary (Bill Moyers) 

5% the dramatlzaUon (high school swimmers) 

38% the animation (the balance beam) 

1% I disliked all parts 

Why: 

9. If there '.s a disagreement between the federal government and a state government, who 
decider the issue? 

3% the President 
^5% the Congress 
60% the Suprraie Couit 
13^ the state legislature 
6% thegovemor of the state 

10. What effect did the CMl War have on the power of the federal government? 

83% it strengthened the federal government's power 

10% it weakened the federal government's power 

6% it had no effect on the federal government's power 

1 1. Based on the program, who do you think has the most powei? 

39% the federal government 

21% the state government 

^ 30% power is shared by federal and state governments 

E RiC 9% rm not sure what the program said about federal and state power 
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Name: 

Sucjects Taugnt: — 
Years of Experience:. 



U.S. CONSTITUTION 
TEACHER QUESTIONNAIRE 



Did you like the program 

_9— yes, a lot 
0 yp^. a little 
° not very much 

_o no, not at all 



2. Do you think the program lb appropriate for students >n grades 7- 1 2? 

_§_yes, definitely 

3 yes, p Jbably 

0 nn, probably not 

0 n n definitely not 
If not, why not? 



3. Do you think the documentary segment (Bill Moyers) was effective'? 

_l_yes, very effective 
__i_yes, sort of effective 
Q T\n not very effective 
_L_no, not at all effective 
If no, why not? 
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4. 



Do you think the dramatic segment (high school swimmers) was 
effective? 



9 yes, very effective 
0 yes, sort of effective 
0 not very effective 
0 nn not at all effective 
If no, why not? 



5. Do you think the animation segment (balance beam) was effective? 



.JL_yes, very effective 
.JL_yes, sort of effective 
^ nn not very effective 
° nn not at all effective 
If no, why not? 



Listed below are the expected outcomes for this program Please indicate 
how well you think the program covered these expected outcomes. 



6. How are powers dividea and shared by the federal and state 
governments of the U5A? 

_2_covered very well 

^ covered 
_o_covered poorly 

Q covered 
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7. 



HOW has the division and sharing of power m the federal system 
changed during different periods of American history? 



1 covered very well 

2 covered 

0 covered poorly 

0 not covered 



8a. What have been the ma)or issues in history about the division and 
sharing of power between the national and state governments'? 

_6 covered very well 

_3 covered 

_o covered poorly 

_o not covered 



8b. How have these issues been resolved? 

Ji covered very well 

_5 covered 

_9 covered poorly 

_2 not covered 



9. Would you recommend this program to other teachers? 

_6 yes, I would highly recommend it 

_3 ^yes, I would recommend it 

_o no, I don't think I would recommend it 

_o no, I would not recommend it 

If r.j, why not? 



10. Do you have any other comments about or suggestions for the 
program? 




Thank Yolig 
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Appendix D 

Discussion Questions 



L How did you like th^ program? 

2. What did you like the most about the program? 

3L What did you like the least about the program? 

4. What did you think the main idea of the program was? 

6i Did you think that David and Maria's relationship was rrallstic? 

& Whi t did you think of the part when David kissed Maria? 

7. If you could talk to the producer, what suggestions would you make? 
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